
Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



© Publication number: 



0 429 391 A1 



EUROPEAN PATENT APPLICATION 



© Application number: 90810275.9 
© Date of filing: 05.04.90 



© Int. CIA G06K 11/18 



® Priority: 06.11.89 IL 92220 

® Date of publication of application: 
29.05.91 Bulletin 91/22 

© Designated Contracting States: 
DE FR GB 

© Applicant: International Business Machines 
Corporation 
Old Orchard Road 
Armonk, N.Y. 10504(US) 



@ Inventor: Medan, Yoav, Dr. 
22066 Las Brisas Circle 
Boca Raton, Florida 33433(US) 
Inventor: Shani, Uri, Dr. 
71 Givat Adi D.N. 
Upper Nazareth 17940(IL) 



© Representative: Rudack, Gunter O., Dipl.-Ing. 
IBM Corporation Saumerstrasse 4 
CH-8803 Ruschiikon(CH) 



© Three-dimensional computer input device. 



CO 

o> 

CM 

o 

Q. 



© The preferred embodiment of this computer in- 
put device comprises a triplet of acceleration detec- 
tors (1...3) associated, respectively, with the three 
mutually orthogonal axes (X, Y, Z) of a coordinate 
system for determining the position in space of the 
input device, and a triplet of gyroscopes (4...6) re- 
spectively associated with the three rotational axes 
(Pitch, Roll, Yaw) of the input device for determining 
the absolute orientation of the input device. Elec- 
tronic circuitry (7...18) is provided to convert the 
analog output signals of the motion sensing devices 
to digital input data to enable the associated com- 
puter to compute the data relative to position and 
orientation of the input device for possible three- 
dimensional interactive graphics and imaging on a 
computer display unit. 
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THREE-DIMENSIONAL COMPUTER INPUT DEVICE 



This invention relates to a manual computer 
input device which permits the computer to com- 
pute the current space orientation and location of 
the device. The known two-dimensional manual 
computer input devices are usually called 
"Mouse" and in analogy it is suggested to call the 
three-dimensional input device of the present in- 
vention a "Space Mouse" For convenience, this 
term will be used throughout the following descrip- 
tion. 

A typical scenario for the useful employ of the 
Space Mouse is in any three-dimensional computer 
graphics applications like CAD-CAM (Computer 
Aided Design - Computer Aided Manufacturing) 
where the interactive, i.e., on-line manipulation of 
three-dimensional objects by the computer under 
control via keyboard and screen is most important. 
This task is very difficult to do with the common 
two-dimensional input devices (mouse, joystick or 
tablet), let alone the multiple one-dimensional input 
via dials and pad. 

In contrast, the hand-held Space Mouse of the 
invention will replace the conventional two-dimen- 
sional mouse in giving direct "virtual" control over 
the three-dimensional graphic objects on the 
screen. The physical feel at hand will be com- 
plemented by the visual feedback from the graphi- 
cally manipulated screen images. 

Many other applications from a large variety of 
fields can benefit from the Space Mouse, clearly 
those requiring multiple parameters, as in naviga- 
tion, simulation of motion, graphical animation, mu- 
sic entry, or even plain conventional two-dimen- 
sional computer graphics. The Space Mouse could 
replace a two-dimensional pointing device by con- 
trolling a screen cursor which corresponds to the 
"tip" of an imaginary "wand" touching the screen. 

The conventional mouse typically positions the 
cursor on the screen of a computer display unit by 
transmitting the movements of a direction sensing 
device in encoded form to the computer. Usually, 
the direction sensing device comprises a ball ar- 
ranged on the bottom side of the mouse and inter- 
acting with a frictional pad on which the mouse Is 
movable in any direction. No transmission occurs 
while the mouse is motionless. Some implementa- 
tions of the mouse have a switch for the transmis- 
sion of a zero incremental movement report when 
the mouse is motionless. 

The encoding of the movements is performed 
in x- and y-increments which cause the cursor to 
follow a generally staircase-shaped track if the 
mouse follows an oblique path, and which be- 
comes, of course, a straight line for movements in 
exact x- or y-directions. The resolution of the en- 



coding is usually performed with a sampling rate of 
100 reports per second and four counts per mil- 
limeter, so that the stairs in an oblique line are 
hardly vtsibie. 

s While the two-dimensional mouse is very wide- 

ly used and accordingly well known so that a 
survey of the relevant prior literature is not deemed 
necessary, the prior art is rather silent as regards 
three-dimensional input devices based on the 

10 mouse concept. Under the title "Three-Dimensional 
Menu" describes the IBM Technical Disclosure 
Bulletin Vol. 29, No. 10, March 1987, p. 4449f., a 
mouse containing two hammers which may be 
individually driven by a solenoid against a spring, 

75 creating the illusion in the hand of the user that the 
mouse moves upward or downward, depending on 
which solenoid was energized. Also, the same im- 
pression is created as the mouse is passed, up- 
ward or downward, over the edge of a sheet of 

20 paper. Despite its three-dimensional capability, the 
mouse of this reference is conceived to always 
remain in contact with the surface on which it is 
moved. 

In contrast, the Space Mouse of this invention 

25 is designed to be lifted off the surface and to be 
freely movable in space. To this end, this three- 
dimensional computer input device comprises 
motion-sensitive means for detecting changes of 
space orientation along three rotational axes and/or 

30 acceleration along the axes of an at least two- 
dimensional coordinate system, and circuit means 
for converting the output signals of said motion- 
sensitive means to a form appropriate for the asso- 
ciated computer to compute the space orientation 

35 and/or location data. The input device is character- 
ized in that said motion-sensitive means comprise 
at least a pair of acceleration detectors each asso- 
ciated with one of the axes of said coordinate 
system, and each connected to electronic circuitry, 

40 and/or a triplet of gyroscopes, respectively asso- 
ciated with said rotational axes and each connected 
to electronic circuitry, said electronic circuitry being 
connected to appropriate input ports of said asso- 
ciated computer. 

45 Details of the invention will hereafter be de- 

scribed by way of example and with reference to 
the drawing in which a schematic configuration of a 
Space Mouse in accordance with the invention is 
shown. 

so The preferred embodiment of the Space 

Mouse in accordance with the invention is imple- 
mented with mechanical gadgets comprising a tri- 
plet of acceleration sensors 1, 2 and 3, respectively 
associated with the usual Cartesian coordinates x, 
Y and Z t and a triplet of gyroscopes, namely a P- 
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gyroscope 4 associated with the pitch axis of the 
Space Mouse, an R-gyroscope 5 associated with 
its roll axis, and a Y-gyroscope 6 associated with 
the yaw axis of the Space Mouse. The rotational 
axes are, of course, mutually orthogonal in space, 
and their respective home positions are not tied to 
the origin or orientation of the rectangular coordi- 
nates X, Y and Z. 

The acceleration sensors 1, 2 and 3 are pro- 
vided to detect displacements of the Space Mouse 
along the directions with which they are associated. 
These displacements are converted to analog sig- 
nals which are made available at individual output 
terminals, such as the output terminal 7 associated 
with X-acceleration sensor 1. 

A gyroscope typically comprises a heavy sym- 
metrical disk free to rotate about an axis which 
itself is confined within a framework such that it is 
free to assume any orientation in space. If the disk 
is set spinning, the direction of its axis of rotation 
will remain fixed in space no matter what motion 
the outer framework undergoes. Gyroscopes have 
a long history of use for providing fixed reference 
directions for such instruments as the gyrocom- 
pass used on ships and similar orientation indica- 
tors used in aircraft. 

The gyroscopes 4, 5 and 6 provide space- 
orientation clues in the form of analog (voltage) 
signals at Individual output terminals, such as out- 
put terminal 8 associated with the roll axis of the 
Space Mouse. These signals permit the determina- 
tion of the absolute orientation of a controlled 
graphical object on whose periphery the Space 
Mouse is moved, for example, with respect to its 
pitch, roll and yaw axes. 

A software interface is preferably provided to 
resolve problems resulting from any instability and 
inaccuracy of displacement sensors 1 , 2 and 3 and 
of gyroscopes 4, 5 and 6. This software interface is 
not, however, a subject of the present invention. 

There is a difference in processing the output 
signals from the acceleration sensors 1, 2 and 3 as 
compared to the output signals from the gyro- 
scopes 4, 5 and 6. The output signals from gy- 
roscopes 4, 5 and 6 on their respective terminals, 
such as on terminal 8 for R-gyroscope 5, are 
supplied to an analog-to-digital converter 9 which 
converts the voltage to a digital representation cor- 
responding to the rate of rotation of the Space 
Mouse around the corresponding sensitive axis. 

To curb small fluctuations on the value of this 
function, a smoothing module 10 is provided which 
essentially consists of a known hysteresis filter (as 
described by R.O. Duda and P.E. Hart in "Pattern 
Classification and Scene Analysis", Wiley Interna- 
tional, 1973, pp. 354ff.). The output signal of 
smoothing module 10 is fed into a digital differen- 
tial analyzer 11 which accumulates a value cor- 



responding to the angle 0 of rotation around the 
corresponding gyroscope axis. 

The acceleration sensors 1, 2 and 3 provide 
voltage signals proportional to the acceleration ap- 

5 plied to the Space Mouse as it is propelled in 
space. These voltage signals at output terminal 7 
are supplied to an analog-to-digital converter 12 the 
output of which is connected to a smoothing mod- 
ule 13. The signal at the output of smoothing 

to module 13 is a measure for the acceleration im- 
parted on the Space Mouse. That signal is further 
fed to a first digital differential analyzer 14 whose 
output signal is related to the velocity of the Space 
Mouse along the respective direction. The result is 

is then passed through a "friction module" 15 which 
reduces this value to zero as a function of time, 
and to a second digital differential analyzer 1 6 from 
whose output signal the displacement value can be 
computed. 

20 While the description has been confined to 

explanations concerning the X-acceleration detector 
1 and its associated circuitry 7, and 12.. .17, and to 
the R-gyroscope 5 and its associated circuitry 
8... 11 and 18, it will be clear to those skilled in the 

25 art that what was said with respect to X-accelera- 
tion detector 1 and R-gyroscope 5 is likewise ap- 
plicable to the other two acceleration detectors 2 
and 3, and to the other two gyroscopes 4 and 6, 
respectively. 

30 In case it is desirable to connect the Space 

Mouse via the dials pad of a graphics unit, the 
output signals from which the rotational and dis- 
placement values are computed may not be taken 
from said digital differential analyzers 11 and 16, 

35 but from pulse generators 17 and 18, respectively. 
These pulse generators will interrupt the controller 
of the graphics unit at the rate of change of those 
values. This rate is controllable by the application 
parameters for sensitivity built into the software 

40 support for the Space Mouse. An example for such 
an interrupt-driven controller is the one of the IBM 
5080 Graphics System. 

The physical arrangement of the acceleration 
detectors 1...3, the gyroscopes 4.. .6, and their as- 

45 sociated electronic circuitry may be such that, for 
example, the detectors and gyroscopes 1...6 to- 
gether with the electronics 7... 18 are located within 
a single hand-held housing connected via cable to 
the computer input ports. 

so Alternatively, the electronics 7...18, or at least 

part of it, may be housed within the computer 
casing so that the hand-held Space Mouse con- 
tains only the said acceleration detectors and gy- 
roscopes. The latter arrangement has the advan- 

55 tage of requiring only simple cabling in view of the 
fact that the output signals of the accelerators 1...3 
as well as of the gyroscopes 4.. .6 are analog vol- 
tages, whereas in the case where the electronics 
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are integrated within the hand-held housing, the 
cabling will have to be adapted to handle digital 
data. 

A scaJed-down version of the six-axes Space 
Mouse described above is a three-axes Space 
Mouse which would include only the object-orienta- 
tion detection components, viz. the gyroscopes 4,5 
and 6. Naturally, the exclusion of the acceleration 
sensors 1 ,2 and 3 will reduce the complexity of the 
Space Mouse yet retain what might be considered 
the more important and meaningful feature of 
three-dimensional orientation. 

Another embodiment of the Space Mouse can 
consist of a pair of acceleration sensors 1 and 2 
associated, respectively, with only the X- and Y- 
directions of the coordinate system, for example, 
and combined with a triplet of gyroscopes 4,5 and 
6. 

Another intermediate variation of the Space 
Mouse is the combination of the object-orientation 
detection components, i.e. the gyroscopes 4,5 and 
6 with a conventional two-dimensional mouse as 
ordinarily used for graphics stations. Thus, the digi- 
tal representations of a three-dimensional space 
orientation plus a two-dimensional surface location 
can be read into the computer by manipulating a 
single hand-held device. 

For ail versions of the Space Mouse described 
above, providing a "zoom" button on the Space 
Mouse will improve the control on the object being 
treated. 



Claims 

1. Three-dimensional computer input device com- 
prising motion-sensitive means (1...3; 4.. .6) for de- 
tecting changes of space orientation along three 
rotational axes (Pitch, Roll, Yaw) and/or movement 
along the axes (X, Y, Z) of an at least two-dimen- 
sional coordinate system, and circuit means (7.. .18) 
for converting the output signals of said motion- 
sensitive means (1 ...3; 4... 6) to a form appropriate 
for the associated computer to compute the space 
orientation and/or location data, characterized in 
that said motion-sensitive means (1...3: 4...6) com- 
prise an at least two-dimension ally operative mo- 
tion detector (1 ...3) associated with at least two of 
the axes (X, Y, Z) of said coordinate system, and 
connected to electronic circuitry (7, 12.. .17), and/or 
a triplet of gyroscopes (4... 6), respectively asso- 
ciated with said rotational axes (Pitch, Roll, Yaw) 
and each connected to electronic circuitry (8...11, 
18), said electronic circuitry (7, 12...17; 8...11, 18) 
being connected to appropriate input ports of said 
associated computer. 

2. Computer input device in accordance with claim 
1, characterized in that said motion-sensitive 



means (1...3; 4.. .6) comprise at least a pair of 
acceleration detectors (1...3) each associated with 
one of the axes (X, Y, Z) of said coordinate system, 
and each connected to electronic circuitry (7, 

s 12... 17), and/or a triplet of gyroscopes (4.. .6), re- 
spectively associated with said rotational axes 
(Pitch, Roll, Yaw) and each connected to electronic 
circuitry (8...11, 18), said electronic circuitry (7, 
12.. .17; 8...11, 18) being connected to appropriate 

io input ports of said associated computer. 

3. Computer input device in accordance with claim 
1, characterized in that said motion-sensitive 
means (1 ...3; 4...6) comprise a triplet of accelera- 
tion detectors (1...3), each being associated with a 

75 coordinate axis (X, Y t Z) orthogonal with respect to 
the other two, and each connected to electronic 
circuitry (7, 12... 17), and/or a and a triplet of gy- 
roscopes (4... 6), respectively associated with said 
rotational axes (Pitch, Roll, Yaw), and each con- 

20 nected to electronic circuitry (8...11, 18), said elec- 
tronic circuitry (7, 12.. .17; 8...11, 18) being con- 
nected to appropriate input ports of said associated 
computer. 

4. Computer input device in accordance with claim 
25 1, characterized in that said motion-sensitive 

means (1...3; 4.. .6) comprise a conventional ball- 
controlled two-dimensional motion detector con- 
nected to electronic circuitry (7, 12...17), and a 
triplet of gyroscopes (4.. .6), respectively associated 
30 with said rotational axes (Pitch, Roll, Yaw) and each 
connected to electronic circuitry (8...11, 18), said 
electronic circuitry (7, 12.. .17; 8...11, 18) being con- 
nected to appropriate input ports of said associated 
computer. 

35 5. Computer input device in accordance with claim 
2 or claim 3, characterized in that the output 
terminal (7) of each of said acceleration detectors 
(1...3) is connected to a chain of electronic circuits 
comprising an analog-to-digital converter (12), a 

40 smoothing module (13), a first digital differential 
analyzer (14), a "friction" module (15), and a sec- 
ond digital differential analyzer (16), the output 
terminal of the latter being connected to an Input 
port of the associated computer. 

45 6. Computer input device in accordance with claim 
1 , characterized in that the output terminal (8) of 
each of said gyroscopes (4...6) is connected to a 
chain of electronic circuits comprising an analog-to- 
digital converter (9), a smoothing module (10), and 

so a digital differential analyzer (11), the output termi- 
nal of the latter being connected to an input port of 
the associated computer. 

7. Computer input device in accordance with claim 
2 or claim 3, characterized in that said accelera- 
55 tion detectors (1...3) and said gyroscopes (4.. .6) as 
well as at least part of the said chains of electronic 
circuits (7, 12...17; 8... 11, 18) are located within the 
common hand-held housing of the input device. 



4 



7 EP 0 429 391 A1 8 



8. Computer input device in accordance with claim 
2 or claim 3, characterized in that said accelera- 
tion detectors (1...3) and said gyroscopes (4.. .6) are 
located within a common hand-held housing of the 
input device, and that at least part of the said 5 
chains of electronic circuits (7, 12.. .17; 8...1 1,18) 

are located within the associated computer. 

9. Computer input device in accordance with claim 
5, characterized in that said second digital dif- 
ferential analyzer (16) is replaced by a pulse gen- io 
erator (17) to permit the connection of the input 
device to the associated computer through the 
dials pad of an interrupt-driven graphics controller. 

10. Computer input device in accordance with 
claim 6, characterized in that said digital differen- is 
tiai analyzer (11) is replaced by a pulse generator 

(18) to permit the connection of the input device to 
the associated computer through the dials pad of 
an interrupt-driven graphics controller. 

11. Computer input device in accordance with 20 
claim 4, characterized in that said conventional 
ball-controlled two-dimensional motion detector and 

its associated electronic circuitry (7, 12.. .17), as 
well as said triplet of gyroscopes (4.. .6) together 
with their associated electronic circuitry (8...11, 18) 25 
are arranged in a common housing. 
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